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ABSTRACT 

In spring 1994, the National Assessment of 
Educational Progress (NAEP) collected information on student 
achievement in reading, U.S. history, and geography at grades 4, 8, 
and 12. To provide a context for interpreting NAEP findings, the 
project collected background information from students, teachers, and 
school administrators using separate questionnaires. This publication 
describes the NAEP teacher background questionnaire, developed by 
individuals with expertise in classroom teaching, survey methodology, 
policy analysis, and educational research. The teacher questionnaire 
was given to teachers of assessed students at grades 4 and 8 only. 
This discussion focuses on analysis issues addressed by three types 
of background questions — instructional content, instructional 
practices, and teacher background, education, and resources — and 
specifies the purposes of the teacher background questions. These 
purposes have to do with existing instructional condi t i ons , 
instructional factors by demographic subgroup, trends in instruction, 
relation of instruction to performance, and changes in performance in 
relation to trends in instruction. A matrix for conceptualizing the 
type, content, and uses of the teacher background questions is 
provided. Selected questions from the NAEP Teacher Background 
Questionnaire are appended. (LL) 
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The I NAEP Teacher 
Background Questionnaire 

In spring 1994, the National Assessment of Educa- 
tional Progress (NAEP) collected information on stu- 
dent achievement in reading, U.S. history, and geog- 
raphy at grades 4, 8, and 12. To provide a context for 
interpreting NAEP findings, the project also collected 
background information from students, teachers, and 
school administrators, using separate questionnaires. 

This Focus on NAEP describes the NAEP teacher back- 
ground questionnaire: How were the questions devel- 
oped? What are the types of questions? How are they 
used? 

Teachers selected to answer background questions are 
those who teach classes containing one or more stu- 
dents participating in the assessment. Because the sam- 
pling for the teacher questionnaire is based on parti- 
cipating students, the responses do not represent all 
teachers in the nation or a state. Rather, the sample 
consists of teachers of the representative sample of stu- 
dents assessed. 

The teacher questionnaire is given to teachers of as- 
sessed students at grades 4 and 8 only. At grade 12, 
relatively few students take the assessed subject areas 
of reading, U.S. history, and geography; therefore, the 
teacher sample sizes are insufficiently large to give the 
questionnaire. The questionnaire has two sections. The 
irst focuses on teachers' background, education, 
•esources, and preparation for teaching in specific 
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subject areas. The second focuses on classroom infor- 
mation including instructional content and practices re- 
lated to each subject area. 

Development of Teacher 
Background Questions 

NAEP's teacher background questions (along with the 
background questions for students and school adminis- 
trators) are developed through a broad-based consen- 
sus process. For the 1994 assessment, information was 
gathered about appropriate background variables from 
mai/' sources. NAEP's governing board convened na- 
tional consensus committees of teachers, scholars, busi- 
ness representatives, policymakers, measurement spe- 
cialists, and members of the public to recommend 
background variables for study. Once developed, this 
information, together with the 1992 background ques- 
tionnaires, was submitted for mail review to 30 educa- 
tion professionals. 

A 1 0-member Background Questionnaire Committee, 
including a member of each subject area committee 
and 7 education professionals who had participated in 
the mail review, was convened by Educational Testing 
Service, the NAEP grantee, to help develop and revise 
the questionnaires for the 1994 assessment. Subject- 
specific questions were developed and reviewed by 
members of the Instrument Development Committees 
in all three subject areas. Finally, state representatives 
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belonging to the NAEP Trial State Assessment NET- 
WORK reviewed them. After they were reviewed and 
cleared by the Office of Management and Budget, 
they were field tested in actual classrooms in 1993 
under conditions sir lilar co those in the actual 1994 
assessment. 

The individuals anc m mittees who developed the 
1994 background questions were instructed to include 
only factors identified by NAEP and other studies to 
be important to student learning and of current interest 
to policymakers, researchers, and content-area educa- 
tors. To maintain NAEP's ability to report trends over 
time, many NAEP teacher background questions were 
drawn from prior assessments. 

In sum, the teacher questionnaire is the product of ex- 
tensive reviews and deliberations by many groups of 



individuals with expertise in classroom teaching, survey 
methodology, policy analysis, and educational research. 

Dimensions of Teacher Background 
Questions 

Table 1 is a matrix for conceptualizing the type, con- 
tent, and uses of the teacher background questions. 
The first dimension specifies three analyst issues that 
background questions address including instructional con- 
tent, instructional practices', and teacher background, education, 
and resources. The second dimension specifies the pur- 
poses of the questions: to describe existing educational condi- 
tions, instructional factors by demographic subgroup, trends in 
instruction, relation of instruction to performance, and changes in 
performance in relation to trends in instruction. The intersect- 
ing cells of the matrix provide examples of research 
questions that may be examined under this conceptual 
framework. 



Table 1.— The NAEP teacher background questionnaire: Analysis issues and purposes 



Analysis issues 



Purpose 


Instructional 
content 


Instructional 
practices 


Teacher background, 
education, and resources 


Existing 

educational 

conditions 


What art teachers 
teaching? 


How art studtnts 
taught? 


\Pbat kinds of educational 

and background experiences 

do teachers bring to the classroom? 


Instructional 
factors by 
demographic 
subgroup 


How dots instructional 
content vary for 
different groups 
of students? 


How do instructional 
practices vary for 
different groups 
of students? 


Are specific groups of 
students taught by teachers 
with different backgrounds? 


Trends in 
instruction 


How has content 
changed overtime? 


Have instructional 
practices changed over time? 


Have teacher characteristics 
changed overtime? 


Relation of 
instruction to 
performance 


Do students exposed 
to particular material 
score higher? 


Do students exposed 
to particular practices 
score higher? 


Does relevant training 
and experience relate to 
better teaching? 


Changes in 
performance in 
relation to trends 
in instruction 


Does performance 
change in relation 
to changes in 
instructional content? 


Does performance 
change in relation 
to changes in 
instructional practices? 


Does performance 
•hange in relation to 
changes in teacher 
characteristics? 
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Analysis Issues 

The three types of background questions — instructional 
content, instructional practices, and teacher background, educa- 
tion, and resources — are broad and inclusive enough to 
address the needs, interests, and concerns of NAEP 
audiences. Knowing what content and instructional 
methods students have been exposed to in the class- 
room is essential to interpreting the assessment results, 
particularly when comparing student groups. 

Instructional Content. Opportunities to learn are af- 
fected by the content covered in the classroom. The 
curriculum may also be implemented differently by in- 
dividual teachers in their classes. As a result, the extent 
to which topics, concepts, and skills are covered may 
vary from teacher to teacher and class to class. Infor- 
mation about students' exposure to reading, U.S. his- 
tory, and geography will answer many questions such 
as the following: 



Sample Instructional Content Questions 

What type of materials form the core of your reading pro- 
gram? (primarily basal, primary trade books, etc.) 
[reading] 

Which best describes the focus of jour social studies /his- 
tory teaching? (state history, U.S. history, etc.) [U.S. 
history] 

How often do you teach the following skills and topics 
as part of geography instruction with this class? (measur- 
ing distance on maps and globes, finding places by using 
latitude and longitude, etc.) [geography] 



Instructional Practices. Student learning is not based 
solely on exposure to content; teachers facilitate learn- 
ing through many instructional practices and experi- 
ences. A few instructional practice questions cut across 
subject areas. Typically these are: grouping students ac- 
cording to ability, amount of instructional time, and 
homework. Most instructional practice questions 
posed to teachers, however, are subject specific. To 
gather information about these subject-specific prac- 



tices and experiences, teachers are asked questions 
such as the following: 



Teacher Background, Education, and Resources. 
NAEP has identified the following characteristics that 
may differ among teachers: type of certification, high- 
est academic degree, undergraduate and graduate major 
and minor, undergraduate and graduate courses, oppor- 
tunities for staff development, and teaching experi- 
ence. While credentials and staff development 
opportunities do not guarantee more effective teach- 
ers, relevant training and experience are assumed to 
contribute to better teaching. Among the questions 
asked in this part of the NAEP teacher questionnaire 
are the following: 



Sample Teacher Background, Education, and 
Resource Questions 

Do you have teaching certification in any of the follow- 
ing areas that is recognised by the state in which you 
teach? 

What were your graduate major fields of study? 

During the past five years, have you participated in 
courses or workshops in any of the following? 



For additional selected teacher background questions,- 
see appendix A. 



Sample Instructional Practice Questions 

How often do you ask students to explain or support 
their understanding of what they have read? [reading] 

How often do you engage your class in using primary his- 
torical documents, letters, diaries, or essays written by 
historical figures? [U.S. history] 

How often do you takzyour class on field trips? 
[geography] 



The Purposes of Teacher 
Background Questions 

Table l's second dimension presents the purposes of 
the information gathered by the teacher background 
questionnaire. The NAEP teacher background ques- 
tionnaire makes it possible to provide descriptive data 
about existing educational conditions, instructional fac- 
tors by demographic subgroup, and trends in instruc- 
tion. Also, information from the questionnaire 
provides opportunities to explore relationships be- 
tween performance and instructional factors that may 
be associated with student achievement. 

Existing instructional conditions, NAEP can inform 
educational policy by collecting descriptive background 
information about existing educational conditions, in- 
cluding instructional content, instructional practices, 
and teacher background, education, and resources. For 
example, it is possible to investigate existing teaching 
practices in geography by asking teachers questions 
such as "How often do students go on field trips that 
relate to the study of geography?" 

Instructional factors by demographic subgroups. 
NAEP collects information on basic demographic 
variables including sex, region, race-ethnicity, type of 
community, type of school, and parental education. 
NAEP can tell us how aspects of education considered 
important are distributed among different groups of 
students. For example, "Are students in rural communi- 
ties typically taught by more experienced teachers?" 

Trends in instruction, A major purpose of the NAEP 
program is to measure change in student performance 
over time among groups of si adents. For example, "In 
what ways have reading materials changed over time?" 



Comparative analyses of performance over two or 
more assessment cycles help engage the nation in dis- 
cussions concerning the condition of American educa- 
tion. Tnese discussions, in turn, provide a context for 
considering educational policy issues that may well re- 
sult in improvements in educational practices. 

P^lation of instruction to performance. Besides the de- 
scriptive data, the background variables collected by 
NAEP are useful in providing an overview of the most 
significant relationships between performance and vari- 
ous background factors across schools for the nation 
as a whole and among groups of students. For exam- 
ple, a researcher may ask "Is there a relationship be- 
tween assigning students to reading classes by ability 
and their overall reading performance?" 

Changes in performance in relation to trends in in- 
struction. Finally, the NAEP data may reveal differ- 
ences in patterns of achievement, given changes in 
instructional content, instructional strategies, and 
teacher characteristics. For example, "Is the increase in 
the use of computers associated with higher average 
proficiency scores?" 

Yet analyzing relationships between performance and 
the teacher's background, instructional content empha- 
sis, and instructional practices does not reveal the un- 
derlying causes of the relationships. That is, without 
further investigation, it is impossible to know if, for ex- 
ample, certain instructional approaches have resulted 
in higher or lower performance. Nevertheless, the 
analysis of the NAEP assessment data using back- 
ground variables can be informative when used in light 
of other knowledge from educational research. 
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Appendix A. Selected Questions 
From NAEP Teacher Background 
Questionnaire 

Grade 4 — Reading 

1. How often do you do the following things as a part of reading 
instruction with this class? 

a. Discuss new or difficult vocabulary. 

b. Ask students to talk to each other about what they have 
read. 

c. Ask students to work in a reading workbook or on a 
worksheet. 

d. Ask students to write about what they have read. 

e. Ask students to do a group activity or project about what 
they have read. 

f. Ask students to read aloud. 

g. Ask students to read silendy. 

h. Give students time to read books they have chosen 
themselves. 

i. Give reading quizzes or tests. 

j. Ask students to discuss different interpretations of what 
they have read. 

k. Ask students to explain or support their understanding of 
what they have read. 

Grade 4 — U.S. History 

1 . About how man^ weeks during the school year do you spend 
covering the following? 

a. Beginnings through the Revolution (e.g., colonization, set- 
dement, revolution) 

b. The new Nation through the Civil War (e.g., expansion, re- 
form, Crisis of the Union) 

c. The development of modern America (e.g., Reconstruc- 
tion, Industrial Growth, U.S. role in world affairs, the 
Great Depression, the First and Second World Wars, 
immigration) 

d. Contemporary America (e.g., civil rights movement, 
women's rights movement, Korean and Vietnam Wars, 
environmental movement) 



2. About how much Co you emphasize the following historical 
theories? 

a. The development of American democracy and politics 

b. The gathering and interactions of peoples, ideas, and 
cultures 

c. The impact of economic and technological changes 

d. The changing role of the United States in the world 

Grade A — Geography 

1 . About how much time do you spend with this class for geogra- 
phy instruction in a typical week? 

2. About how much geography homework do you assign a stu- 
dent in this class each week? 

3. How often do your students complete projects that relate to 
die study of geography? 

4. How often do your students participate in local, state, or na- 
tional geography contests? 

5. How often do you use computers in the teaching of 
geography? 

6. Which of the following plays the central role in your geogra- 
phy curriculum? 

7. How much do you like teaching geograp*"'? 

Note 

Focus on NAEP is a new series that briefly summarizes 
information about the ongoing development and im- 
plementation of the National Assessment of Educa- 
tional Progress. The series is a product of the National 
Center for Education Statistics (NCES), Emerson J. 
Elliott, Commissioner, and Gary W. Phillips, Associ- 
ate Commissioner for Education Assessment This is- 
sue was written by Sheida White. Readers are invited 
to comment by contacting the author at NCES, Educa- 
tion Assessment Division, 555 New Jersey Avenue 
NW, Washington, DC 2020&-5653. To order other 
NAEP publications, call Bob Clemons at 301—763— 
1968. 
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